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Transmitted herewith for filing is the patent application of 
inventus): Jyri HUOPANIEMI, Riitta VAANANEN 

WARNING: 37 C.F.F. § 1.41(a)(1) points out: 

"(a) A patent is applied for in the name cr names of the actual inventcr cr inventors. 

'(1) The inventorship of a ncr: provisional application is that inventorship set forth in the oath cr 
declaration as presented by § 1.63. except as provided for in § 1.53(d)(4) and § 1.63(d). If an 
oath or dedarznen as presented by § 1.63 is net filed during the pendency of a ncnprcvisicnsJ 
application, the inventorship is that inventorship set forth in the application papers filed pursuant 
to § 1, 53(b), unless a petition under this paragraph accompanied by the fee set forth in § 1.17(f) 
is filed supplying or changing the name cr names of the inventcr or inventors, ' 



O 



For (title): 



METHOD AND SYSTEM FOR PROCESSING DIRECTED SOUND IN AN ACOUSTIC 
VIRTUAL ENVIRONMENT 



CERTIFICATION UNDER 37 C.F.R. 1.10* 
(Express Mail labei number is mandMiary.) 
(Express Mail certification is optional.) 



I hereby certify that this New Application Transmittal and the documents referred to as attached therein are beina 
deposited with the United States Pcstai Service en this date March 22, 1999 Jn ^ 



— , — wiuvc^ ouitca rental oervica en mis care — , - ~ — 

as -Express Mail Pest Office to Addressee/ mailing Label Number EL06709a75?MS 
dressed to the; Assistant Ccmmissicner for Patents, Washington, D.C. 20231. 

Deborah J. Clark 



ad- 



(type cr print name of person mailing paper) 

Signature of penw$ mailing paper 
WARNING: Certificate of mailing (first class) cr facsimile transmission procedures of 37 C.F.P.. 1.8 cannot be 
used to cctssn a date of mailing cr transmission for this correspondence. 

^WARNING: Eacn paper or fee Hied by 'Express Mail* must have the number of the 'Express Mail' mailing facet 
placed thereon pnor to mailing. 37 C.F.R. 1.10(b). 

'Since the filing of correspondence under §1.10 without the Express Mail mailing lacel therecn 
is an cverstgnt that can be avoided by the exercise of reasonable care, requests for waiver of this 
requirement will not be granted on petition, * Notice of Oct. 24, 1 996, 60 Fed. Reg. 55. 439, at 56". 442. 
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1. Type of Application 

This new application is for a(n) 

(check one applicable Item below) 

Original (nonprovisionai) 

□ Design 
□ Plant 

WARNING: Do not use this transmittal for a completion in the U.S. of an International Application under 35 
U.S.C. 371(c)(4), unless the International Application is being filed as a divisional, continuation or 
continuation-in-part application. 

WARNING: Do not use this transmittal for the filing of a provisional application. 

NOTE: if one of the following 3 items apply, then complete and attach ADDED PAGES FOR NFWAPPUCA VON 
TRANSMITTAL WHERE BENEFIT OF A PRIOR U.S. APPLICATION CLAIMED and a NOTiFiCATlON 
IN PARENT APPLICATION OF THE FILING OF THIS CONTINUATION APPLICATION. 

□ Divisional. 

□ Continuation. 

□ Continuation-in-part (C-l-P). 

2. Benefit of Prior U.S. Application(s) (35 U.S.C. 119(e), 120, or 121) 

NOTE A nonprovisionai application may claim an invention disclosed in one or more prior Hied copending 
nonprovisionai applications or copending international applications designating the United States of 
America. In order for a nonprovisionai application to claim the benefit of a prior filed copending 
nonprovisionai application or copending international application designating the United States of 
America, each prior application must name as an inventor at least one inventor named in the later Hied 
nonprovisionai application and disclose the named inventor's invention daimed in at least one claim 
of the later filed nonprovisionai application in the manner provided by the first paragraph of 35 U.S.C. 
1 1Z Each prior application must also be: 

(i) An international application entitled to a filing date in accordance with FCT Article 1 1 and 
designating the United States of Amenca; or 

(ii) Complete as set forth in § 1.51(b); or 

(iii) Entitled to a filing date as set forth in § 1.53(b) or § 1.53(d) and include the basic filing fee set 
forth in § 1.16; or 

(iv) Entitled to a filing date as set forth in § 1.53(b) and have paid therein the processing and retention 
fee set forth in § 1.21(1) within the time period set forth in § 1.53(f). 

37 C.r.R § 1.73(a)(1). 

NOTE: If the new application being transmitted is a divisional, continuation or a continuation-in-part of a parent 
case, or where the parent case is an International Application which designated the U.S., or benefit 
of a prior provisional application is claimed, then check the following item and complete and attach 
ADDED PAGES FOR NEW APPLICATION TRANSMITTAL WHERE BENEFIT OF PRIOR U.S. APPLICA- 
TION® CLAIMED, 

WARNING: If an application claims the benefit of the filing data of an earlier filed application under 35 U.S.C. 

120, 121 cr 365(c), the 20-year term of that application will be based upon tr>e filing date of the 
earliest U.S. application that the application makes reference to under 35 U.S.C. 120. 121 or 365(c). 
(35 U.S.C. 154(a)(2) does not take into account, for the determination of the patent term, any 
application on which pnonvy is claimed under 35 U.S.C. 119, 365(a) or 365(b).) For a cH-p 
application, applicant should review whether any claim in the patent that will issue is supported 
by an earlier application and, rf net, the applicant should consider canceling the reference to the 
earlier filed application. The term of a patent is not based on a daim-by-daim approach. See Notice 
ofApnl U, 1395, 60 Fed. Reg. 2G r 1S5, at 20,205. 
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WARMING: When ±0 last day of pendency of a provisional appiicacoi falls on a Saturday. Sunday, or Federal 
holiday within the Distnct of Columbia, any nonprovisional application claiming benefit of :ne 
provisional application must be filed pn'or to the Saturday, Sunday, or Federal holiday within tne 
Cistnci of Columbia. See 37 C.F.R § 1.73(a)(3). 

□ Tne new aopiicaticn being transmitted claims tne benefit of prior U.S. applica- 
tion^). Enclosed are ADDED PAGES FOR NP/V APPLICATION TRANSMITTAL 
WHERE BENEFIT OF PRIOR U.S. APFL!CATiCN(S) CLAIMED. 
3. Papers Enclosed 

A, Required for filing date under 37 C.F.R. § 1.53(b) (Regular) or 37 C.F.R. § 1 1-3 
(Design) Application 

-15— Pages cf specification 

—3— Pages of claims 

— L_ Sheets cf drawing 

WARNING: CO NOT submit onginal drawings. A high quality cccy of drawings should be sucpiied wren 
fang a patent application. The drawings that are submittec to tne Office must be on strong, write, 
smooth, and ncn-sh:ny pacer and meet the standards accoroing to § 1.3-d. If corrections to the 
drawings an necsssar/, they should be made to the onginal drawing and a high-quality cccy of 
the corrected onginal drawing then sucmitted to the Office. Only one copy is required or desired. 
For comments on proposed then-new 37 CFR 1.34 see Nodes cfMarci 9, 198a (1990 O.G. 57-62). 
NOTE: 'Identifying indica r if provided, should include the apciicav'on numcer or foe title of tea invention, 
inventor's name, docket number (if any), and the name and teiepnone numcer of a person to cat! if 
the Office is unable to match the drawings to the proper apeticazen. Tms information should be placed 
on the back of each sheet of drawing a minimum distance cf 1.5 cm. (5/3 incn) down from the tec 
of the page . . .* 37 C.F.R. 1.84(c)), 

(complete the following, if applicztle) 

□ The enclosed drawing(s) are photograph(s), and there is aiso attached a 
"PETITION TO ACCEPT PHOTOGRAPH® AS DRAWING(S)." 37 C.F.R. 1.84(b). 

□ formal 

□ informal 

B. Other Papers Enclosed 

Pages of declaration and power of attorney 

— L_ Pages cf abstract 

Other 

4. Additional papers enclosed 

□ Amendment to claims 

□ Cancel in this applications claims befcre 

calculating the filing fee. (At least one onginal independent claim must be 
retained for filing purposes.) 

□ Add the claims shown on the attached amendment. (Claims added have 
been numbered consecutively following the hignest numbered original 
claims.) 

□ Preliminary Amendment 

□ Information Disclosure Statement (37 C.F.R. 1.98) 

□ Form PTO-1449 (PTO/SS/08A and C8B) 

□ Citations 
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□ Declaration of Biological Deposit 

□ Submission of "Sequence Listing," computer readable copy and/cr amendment 
pertaining thereto for biotechnology invention containing nucleotide and/cr 
amino acid sequence. 

□ Authorization of Attomey(s) tc Accept and Foiiow instructions from Representa- 
tive 

□ Special Comments 

□ Other 

5. Declaration or oath (Including power of attorney} 

NO Tc: A newly executed declaration is net required in a continuation cr divisional aposicaticn prodded that 
the pner nonprovisicnal application contained a declaration as required, the acpiicaocn being filed is 
by all or fewer than all the inventors named in the pnor application, there is no'new matter m the 
acpiication being filed, and a copy of tr.e executed declaration filed in the pnor application (snowing 
the signature cr an indication thereon that it was signed) is submitted. Tne oocy must be accompanied 
by a statement requesting deletion of the names of persenfs) who are not inventors of the acdication 
being filed. If the declaration in the pnor application was filed under § 1.47, tnen a copy of tnat 
declaration must be filed accompanied by a copy of the decision granting § 1.47 status or, if a nensignmg 
person under §1.47 has subsequently joined in a pnor application, then a copy of the suzseq^enfy 
executed declaration must be filed. See 37 C.F.R §§ 1.63(d)(1H3). 

NOTE: A declaration filed to complete an application must be executed, identify the specification to wmcn it 
is directed, identify each inventor by full name including family name and at least one given name, without 
abbreviation together with any ether given name cr initial, and the residence, pest office adcrsss and 
country or citizenship of each inventor, and state whether the inventor is a sole or joint inventor. 37 
CF.fi. § 1.63(a)(1H4). 

□ Enclosed 
Executed by 

(check all applicable boxes) 

□ inventors). 

□ legal representative of inventor(s). 
37 CFR 1.42 or 1.43. • 

□ joint inventor or person showing a proprietary 
interest on behalf of inventor who refused to sign 
cr cannot be reached. 

□ This is the petition required by 37 CFR 1 .47 and the statement 
required by 37 CFR 1.47 is also attached. See item 13 belcw fcr 
fee. 

H Not Enciosed. 

NOTE: Where the filing is a completion m the U.S. of an International Application or wnere the completion of 
the U.S. apeficavon contains subject matter tn addition to the International Apchcaticn, the acolicaticn 
may be treated as a continuation cr continuation-in-part, as the case may be. utilizing AOCED PAGE 
FOR NEW APPLICATION TRANSMITTAL WHERE BENEFIT OF PRIOR U.S. APPLICATION CLAIMED 

O Application is made by a person authorized under 37 C.F.R. 1.41(c) cr. behalf 
of all the above named inventcr(s). 

(The declaration or oath, along with the surcharge required by 37 CFR 1.15(e) 

can be filed subsequently). 

□ Showing that the filing is authorized. 

(not required unless called into question. 37 CFR 1.41(d)) 
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6. Inventorship Statement 

WARNING: If the named inventors are each not the inverters of ail the claims an explanation, inducing the 
ownership of the various claims at the time the last claimed invention was made, should be 
submitted. 

The inventorship for all the claims in this application are: 

□ Trie same. 

or 

□ Not the same. An explanation, including the ownership of the vahcus claims at 
the time the last claimed invention was made, 

□ is submitted. 

□ will be submitted, 

7. Language 

NOTE' An application including a signed oath or declaration may be filed m a language other than Engiisn. 
An English translation of the non-English language application and the processing fee of $130.00 
required by 37 CFR 1.17(h) is required to be filed wtth the application, or within sucn time as may be 
set by the Office. 37 CFR 1.52(d), 

£j Engiish 

□ Non-English 

□ Tne attached translation includes a statement that the translation is accu- 
rate. 37 C.F.R. 1.52(d). 

8. Assignment 

Nokia Mobile Phones Limited 
E3 An assignment of the invention to _ 



□ is attached. A separate □ "COVER SHEET FOR ASSIGNMENT (DOCU- 
MENT) ACCOMPANYING NEW PATENT APPLICATION" cr □ FORM PTO 
15S5 is also attached. 

0 wiil follow. 

NO 7c; "If an assignment is submitted with a new application, send fwo secarate letters-cne for the application 

and one for the assignment' Notice of May 4, 1990 (1114 O.G. 77-73). 
WARNING: A newly executed 'CERTIFICATE UNDER 37 CFR 3. 73(b) * must be filed wr.en a ccntinuation-in-pan 
application is filed by an assignee. Notice of April 30, 1S53, 1150 CO. 62-64. 
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9. Certified Copy 

Certified copy(ies) of application® 



Country 


Appin. No. 


Fiiec 


Finland 


980649 


March 23, 1998 


Country 


Appin. No. 


Filed 


Country 


Appin. No. 


Filed 



from whicJi priority is claimed 
□ is (are) attached. 
j£g will fellow. 

NOTE. The foreign acciicaticn farming the basis for the claim for pnenvy must be referred to in &e oath or 
declaration. 37 CFR 1.55(a) and 1.S3. 

NO 7c; This item is fcr any foreign pnenry for wr.icn the acpticancn temg filed directly reiates. If any parent 
U.S. apclicavcn or International Application from which thts acpiicaven dajms benefit under 25 U.S.C. 
120 is ttsesf entitlec to pnenvy from a pnor foreign application, fcen complete item 18 on the ACCED 
PAGES FOR NEN APPLICATION TRANSMITTAL WHEPE BENEFIT CF PP1CP U.S. APPUCATCNCS) 
CLAIMED. 

10. Fee Calculation (37 C.F.R. 1.16) 
A. □ Regular application 



CLAIMS AS FILED 


Number filed 


Number Extra 




Rate 


Basic Fee 
37 C.F.R. 1.16(a) 
$760.00 


Total 

Claims (37 CFR 1.16(c)) 14- 


20 = 0 


X 


S 18.00 




Independent 

Claims (37 CFR 1.16(b)) 2 - 


3 = 0 


X 


S 78.00 




Multiple dependent claim(s), 
if any (37 CFR 1.16(d)) 






S 260.00 





□ Amendment cancelling extra ciaims is enclosed. 

□ Amendment deieting multiple-dependencies is enclosed. 

□ Fee fcr extra claims is not being paid at this time. 

NOTE: If the fees for extra claims are not paid cn filing they must be paid or the claims cancailed by amendment, 
pnor to the expiration of the time penod set for response oy the Patent and Trademark Office in arty 
nance of fee deficiency. 37 CFR 1.16(d): 

Filing Fee Calculation S 760.00 

B. □ Design application 

(S 310.00—37 CFR 1.16(f)) 

Filing Fee Calculation S 

C. □ Plant application 

(S. 480. 00— 37 CFR 1.16(g)) 

Filing fee calculation S 
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11, Small Entity Statement(s) 

□ Statement(s) that this is a filing by a small entity under 37 CFH 1.9 and 1.27 
is (are) attached. 

WARNING; "Status as a small entity must be specifically established in eacn application or patent in when 
the status is available and desired. Status as a small entity in one acdicaticn cr patent dees net 
affect any ether application or patent, including apciicaticns cr patents watch are birectiy cr 
indirectly Pecendent upon the application cr patent tn #nich the status nas teen established. Tr.e 
refiitng of an apdicav.cn under § 1.53 as a continuation, civtsicn, cr continLaticn-m-part (inducing 
a continued prcsecut'cn application uncer § 1.53(d)), cr the filing cf a reissue abdication requires 
a new determination as to continued entitlement tc small entrry status fcr ire continuing cr reissue 
application. A ncncrcvrsicnaJ application claiming benefit under 36 U.S.C. 119(e), 120, 121, or 
365(c) of a pner ac plication, cr a reissue application may reiy cn a statement filed in the pnor 
abdication or in the patent if the ncn provisional acpHcztcn cr the reissue application incudes a 
reference to the statement in the prior appiicaticn cr in the patent or includes a copy cf the 
statement in the pnor appiicaticn cr in the patent and status as a small entity is still proper and 
desired. The payment cf the small entity basic statutory filing fee 'mil be t~eated as such a reference 
for purposes of this section.' 37 C.f.R § 1.23(a)(2). 

(complete the folic wing, if applicable) 

□ Status as a small entity was claimed in pricr appiicaticn 

/ . fiied on , from which benefit 

is being claimed fcr this appiicaticn under. 

35 U.S.C. □ 119(e), 

□ 120, 

□ 121, 

□ 365(c), 

and which status as a smalt entity is still proper and desired. 
□ A copy cf the statement in the phcr appiicaticn is included. 
Filing Fee Calcuiaticn (50% cf A, B cr C above) 

S 

NCTc; Any excess cf the full fee paid will be refunded if small endty status is established and a refund request: 
are fiied within 2 months of the date of timely payment of a full fee. Tne f^vc-mcnth pehed is not 
extendable under § 1.136. 37 CFR 1.28(a). 

12. Request for International-Type Search (37 C.F.R. 1.104(d)) 

(complete, if applicable) 

□ Please prepare an international-type search report fcr this application at the tine 
when national examination on the merits takes place. 
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13. Fee Payment Being Made at This Time 

□ Not Enclosed 

□ No filing fee is to be paid at this time. 

(This and the surcharge required by 37 C.F.R. 1.15(e) can be paid subse- 
quently.) 

E Enclosed 

0 Filing fee $ 760.00 

□ Recording assignment 
(S4Q.00; 37 C.F.R 1.21(h)) 

(See attached "COVER SHEET FOR 
ASSIGNMENT ACCOMPANYING NEW 

APPLICATION".) S 

□ Petition fee for filing by other than all the 
inventors or person on behalf of the inventor 
where inventor refused to sign or cannot be 
reached 

($130.00; 37 C.F.R. 1.47 and 1.170) S 

□ For processing an application with a 
specification in 

a non-English language 

(3130.00; 37 C.F.R. 1.52(d) and 1.1 7(k)) $ 

□ Processing and retention fee 

(3130.00; 37 C.F.R. 1.53(d) and 1.21(1)) $ 

□ Fee for international-type search report 

(S40.CC; 37 C.F.R. 1.21(e)) $ 



NOTE: 37 CrR 1.21(1) establishes a fee for processing and retaining any application that is abandoned for failing 
to complete the application pursuant to 37 CFR 1.53(f) and this t as wdl as the changes to 37 CFR 1.53 
and 1.78(aXl), indicate that in order to obtain the benefit of a prior U.S. application, either the basic 
filing fee must be paid, or the processing and retention fee of § 1.21(1) must be paid, within 1 year from 
notification under § 53(f). 

Total fees enclosed s 760 - 00 

14. Method of Payment of Fees 

H Check in the amount of S 760.00 

□ Charge Account No. in the amount of 



A duplicate of this transmittal is attached. 

NO 7c; Fees should be itemized in such a manner that it is dear for which purpose the fees are paid 37 CFP 
1.22(b). 
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15. Authorization to Charge Additional Fees 

WAPN1NG: if no fees are to be paid on filing, the following items snould not be completed. 

WARNING; Accurately count daims, especially multiple dependent daims, to avoid unexpected high charges, 
if extra claim charges, are authcnzed. 

(3 Trie Commissioner is hereby authorized to charge the following additional fees 
by this pacer and during the entire pendency of tnis acciicaticn to Account Nc. 
16-1350 * 

E 37 C.F.R. 1.16(a), (f) or (g) (filing fees) 

t2 37 C.F.R, 1.16(b), (c) and (d) (presentation of extra claims) 

NOTE; Because additional fees for excess or multiple dependent daims net paid cn filing or on later presentation 
must cnty b-e paid cr these claims cancelled by amendment pnpr to the expiration cf the time per.cd 
set for response by the PTO in any notice cf foe deficiency (37 CFR 1. 16(d)), it might be best net tc 
authorize the PTO to charge additional daim f&es, except possibly wnen deaiing with amendments after 
finai action. 

E 37 C.F.R. 1.16(e) (surcharge for filing the basic filing fee and/cr declaration 
cn a date later than the filing date cf the application) 

E 37 C.F.R, §§ 1.17(a)(1K5) (extension fees pursuant to § 1.136(a)). 

□ 37 C.F.R. 1.17 (application processing fees) 

NOTE: . A wnttart request may be submitted in an application that :s an authenzation to treat any concurrent 
cr future reply, requinng a petition for an extension of time under this paragraph for its timely submission, 
as inccrpcracng a petition for extension of time for the apcropnate length of time. An authorization to 
charge ail required fees, fees under § 1.17, cr ail required extension of time fees will be treated as a 
censtructrse petitcn for an extension of time in any concurrent cr future reply requiring a petition for 
an extension cf time under this paragraph for its timely submission. Submission cf the fee set forth in 
§ 1.17(a) will also b-e treated as a constructive petition for an extension cf time in any concurrent reply 
requinng a petition for an extension of time under this paragrarn for its timely submission. * 37 C.F.R 
§ 1.136(a)(3). 

□ 37 C.F.R. 1.13 (issue fee at cr before mailing cf Notice cf Allowance, 
pursuant to 37 C.F.R 1.311(b)) 

NOTE: Where an auxhonzazon to cnarge the issue fee to a deposit account has c-een ffied before the mailing 
cf a Notice of Allowance, the issue fee will be automatically cnarged tc the depesri account at the time 
of mailing the notice cf allowance. 37 Cr3 1.3110c). 

NOTE: 37 CFR 1.28(b) requires "Notification of any change in status resulting in less of entitlement to small 
entity status must be filed in the application . . . prior to paying, or at the time of paying, . . . the issue 
fee. . . .* From the wording of 37 CFR 1.23(b), (a) notification of cnange of status must be made even 
if the fee is paid as "other than a small entity" and (b) no nctificatcn is required if tne change is to 
another small entry, 
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16. Instructions as to Overpayment 

NOTE* . . Amounts of twenty-five dollars or less wilt not be returned unless specifically requested within 
a reasonable time, nor will the payer be notified of such amounts: amounts over twenty-five dollars may 
be returned by check or, if requested, by credit to a deposit account" 37 C.F.B. § 136(a). 

0 Credit Account No. 16 " 135Q 

□ Refund 



SEND ALL CORRESPONDENCE T 




Reg. No. 24,622 



Tel. No. (203 ) 259-1800 



Customer No. 



SIGNATURE OF PRACT$T10Nf 

Clarence A. Green 



{type or pnnt name of attorney) 
PERMAN & GREEN, LLP 



P.O. Address 
425 Post Road 
Fairfield, CT 06430 
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□ Incorporation by reference of added pages 

(check the following item if the application in this transmittal claims the benefit of 
prior U.S. appfication(s) (including an international application entering the U.S. 
stage as a continuation, divisional or C-/-P application) and complete and attach 
the ADDED PAGES FOR NEW APPLICATION TRANSMITTAL WHERE BENEFIT OF 
PRIOR U.S. APPLICATIONS) CLAIMED) 

□ Plus Added Fages for New Application Transmittal Where Benefit of Prior U.S. 
Applicaticn(s) Claimed 

Number of pages added 

□ Pius Added Pages for Papers Referred to in ftem 4 Above 

Number of pages added 

□ Plus added pages deleting names of inventors) named in prior applications) 
who is/are no [cnger inventory) of the subject matter claimed in this application. 

Number of pages added 

□ Pius "Assignment Cover Letter Accompanying New Application" 

Number of pages added 

E Statement Whera No Further Pages Added 

(if no further pages form a part of this Transmittal, then end this Transmittal with 
this page and check the following item) 

E This transmittal ends with this page. 
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TITLE; Method and system for processing directed sound in an acoustic virtual 
environment 



TECHNOLOGICAL FIELD 

Tiie invention relates to a method and a system with, which an artificial audible im- 
pression corresponding to a certain space can be created for a listener. Particularly 
5 the invention relates to the processing of directed sound in such, an audible impres- 
sion and to the transmitting of the resulting audible impression in a system where 
the information presented to the user is transmitted, processed and/or compressed in 
a digital form. 



10 BACKGROUND OF THE INVENTION 

An acoustic virtual environment means an audible impression with the aid of which 
the listener to an electrically reproduced sound can imagine that he is in a certain 
space. Complicated acoustic virtual environments often aim at imitating a real 
space, which is called auralization of said space, This concept is described for in- 

15 stance in the article M. Kleiner, B.-I, Dalenb&ck, P. Svensson: "Auralization - An 
Overview" 5 , 1993, J, Audio Eng. Soc, vol. 41, No, 11, pp. 861 - 875. The auraliza- 
tion can be combined in a natural way with the creation of a visual virtual environ- 
ment, whereby a user provided with suitable displays and speakers or a headset can 
examine a desired real or imaginary space, and even "move around" in said space, 

20 whereby he gets a different visual and acoustic impression depending on which 
point in said environment he chooses as his examination point. 

The creation of an acoustic virtual environment can be divided into three factors 
which are the modeling of the sound source, the modeling of the space, and the 
modeling of the listener. The present invention relates particularly to the modeling 
25 of a sound source and the early reflections of the sound. 

The VRML97 language (Virtual Reality Modeling Language 97) is often used for 
modeling and processing a visual and acoustic virtual environment, and this lan- 
guage is treated in the publication ISO/EEC JTC/SC24 IS 14772-1, 1997, Informa- 
tion Technology - Computer Graphics and Image Processing - The Virtual Reality 



2 



Modeling Language (VRML97), April 1997; and on the corresponding pages at the 
Internet address http://www.vnnl. org^ Another set of rules 

being developed while this patent application is being written relates to the Java3D ? 
which is to become the control and processing environment of the VRML, and 
5 which is described for instance in the publication SUN Inc. 1997; JAVA 3D API 
Specification 1.0; and at the Internet address http://wwwjavasoftxom/- 
products/java-media/3D/forDevelopers/3DguideA. Further the MPEG-4 standard 
(Motion Picture Experts Group 4) under development has as a goal that a multime- 
dia presentation transmitted via a digital communication link can contain real and 
10 virtual objects, which together form a certain audiovisual environment. The MPEG- 
4 standard is described in the publication ISO/IEC JTC/SC29 WGll CD 14496. 
1997: Information technology — Coding of audiovisual objects. November 1997; 
and on the corresponding pages at the Internet address http://www.cseltit/- 
mpeg/pubhc/mpeg-4_cd.htm, 

15 Figure 1 shows a known directed sound model which is used in VRML97 and 
MPEG-4. The sound source is located at the point 101 and around it there is imag- 
ined two ellipsoids 102 and 103 within each other, whereby the focus of one ellip- 
soid is common with the location of the sound source and whereby the main axes of 
the ellipsoids are parallel. The sizes of the ellipsoids 102 and 104 are represented by 

20 the distances maxBack, maxFront, minBack and minFront measured in the direction 
of the main axi$. The attenuation of the sound as a function of the distance is repre- 
sented by the curve 104. Inside the inner ellipsoid 102 the sound intensity is con- 
stant, and outside the outer ellipsoid 103 the sound intensity is zero. When passing 
along any straight line through the point 101 away from the point 101 the sound in- 

25 tensity decreases linearly 20 dB between the inner and the outer ellipsoids. In other 
words, the attenuation A observed at a point 105 located between the ellipsoids can 
be calculated from the formula 

A = -20 dB - (d'AT) 

where <¥ is the distance from the surface of the inner ellipsoid to the observation 
30 point, as measured along the straight line joining the points 101 and 105, and d" is 
the distance between the inner and outer ellipsoids, as measured along the same 
straight line. 

In Java3D directed sound is modeled with the ConeSound concept which is illus- 
trated in figure 2, The figure presents a section of a certain double cone structure 
35 along a plane which contains the common longitudinal axis of the cones. The sound 
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source is located at the common vertex 203 of the cones 201 and 202. Both in the 
regions of the front cone 201 and of the back cone 202 the sound is uniformly at- 
tenuated. Linear interpolation is applied in the region between the cones. In order to 
calculate the attenuation detected at the observation point 204 you must know the 
5 sound intensity without attenuation, the width of the front and back cones, and the 
angle between the longitudinal axis of the front cone and the straight line joining the 
points 203 and 204. 

A known method for modeling the acoustics of a space comprising surfaces is the 
image source method, in which the original sound source is given a set of imaginary 

10 image sources which are mirror images of the sound source in relation to the reflec- 
tion surfaces to be examined: one image source is placed behind each reflection sur- 
face to be examined, whereby the distance measured directly from this image source 
to the examination point is the same as the distance from the original sound source 
via the reflection to the examination point. Further, the sound from the image source 

15 arrives at the examination point from the same direction as the real reflected sound. 
The audible impression is obtained by adding the sounds generated by the image 
sources. 

The prior art methods are very heavy regarding the calculation. If we assume that 
the virtual environment is transmitted to the user for instance as a broadcast or via a 

20 data network, then the receiver of the user should continuously add the sound gen- 
erated by even thousands of image sources* Moreover, the bases of the calculation 
always changes when the user decides to change the location of the examination 
point. Further the known solutions completely ignore the fact that in addition to the 
direction angle the directivity of the sound strongly depends on its wave-length, in 

25 other words, sounds with a different pitch are directed differently. 

From the Finnish patent application number 974006 (Nokia Corp,) and the corre- 
sponding US patent application number 09/174989 there is known a method and a 
system for processing an acoustic virtual environment. There the surfaces of the 
environment to be modeled are represented by filters having a certain frequency re- 
30 sponse. In order to transmit the modeled environment in digital transmission form it 
is sufficient to present in some way the transfer functions of all essential surfaces 
belonging to the environment. However, even this does not take into account the ef- 
fects which the arrival direction or the pitch of the sound has on the direction of the 
sound. 
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SUMMARY OF THE INVENTION 

The object of the present invention is to present a method and a system with which 
an acoustic virtual environment can .be transmitted to the user with a reasonable cal- 
culation load. A further object of the invention is to present a method and a system 
5 which are able to take into account how the pitch and the arrival direction of the 
sound affect the direction of the sound. 

The objects of the invention are attained by modeling the sound source or its early 
reflection by a parametrized sy^temilfqnction where it is possible to set a desired di- 
rection of the sound with the aid df different parameters and to take into account 
10 how the direction depends on the frequency and on the direction angle, 

The method according to the invention is characterized in that in order to model 
how the sound is directed a direction dependent filtering arrangement is attached to 
the sound source of an acoustic virtual environment so that the effect of the filtering 
arrangement on the sound depends on predetermined parameters 

15 The invention relates also to a sysjtem which is characterized in that it comprises 
means for generating a filter banlt which comprises parametrised filters for the 
modeling how the direction from Hit sound sources belonging to the acoustic virtual 
environment 

According to the invention the motiel of the sound source or the reflection calcu- 
20 lated from it comprises direction dependent digital filters. A certain reference direc- 
tion, called the zero azimuth, is selected for the sound. This direction can be di- 
rected in any direction in the acoustic virtual environment In addition to it a number 
of other directions are selected, in which it is desired to model how the sound is di- 
rected. Also these directions can be selected arbitrarily. Each selected other direc- 
25 tion is modeled by an own digital filter having a transfer function which can be se- 
lected either to be frequency dependent or frequency independent In a case when 
the examination point is located somewhere else than exactly in a direction repre- 
sented by a filter it is possible to form different interpolations between the filter 
transfer functions, 

30 When we want to model sound and how it is directed in a system where the infor- 
mation must be transmitted in a digital form it is necessary to transmit only the data 
about each transfer function. The receiving device, knowing the desired examination 
point determines the wound is directed from the location of the sound source to- 
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wards the examination point with the aid of the transfer functions it has recon- 
structed. If the location of the examination point changes in relation to the zero azi- 
muth the receiving device checks how the sound is directed towards the new exami- 
nation point. There can be several sound sources, whereby the receiving device cal- 
5 culates how the sound is directed from each sound source to the examination point 
and correspondingly it modifies the sound it reproduces. Then the listener obtains 
an impression of a correctly positioned listening place, for instance in relation to a 
virtual orchestra where the instruments are located in different places and where 
they are directed in different ways. 

10 The simplest alternative to realize direction dependent digital filtering is to attach a 
certain amplification factor to each selected direction. However, then the pitch of 
the sound will not be taken into account. In a more advanced alternative the exam- 
ined frequency band is divided into sub-bands, and for each sub-band there are pre- 
sented their own amplification factors in the selected directions. In a further ad- 

15 vanced version each examined direction is modeled by a general transfer function, 
for which certain coefficients are indicated which enable the reconstruction of the 
same transfer functions, 



BRIEF DESCRIPTION OF DRAWINGS 

20 Below the invention is described in more detail with reference to preferred em- 
bodiments presented as examples and to the enclosed figures, in which 

Figure 1 shows a known directed sound model; 

Figure 2 shows another known directed sound model; 

Figure 3 shows schematically a directed sound model accordin g to the invention; 

25 Figure 4 shows a graphical representation of how the sound is directed, generated 
by a model according to the invention; 

Figure 5 shows how the invention is applied to an acoustic virtual environment; 
Figure 6 shows a system according to the invention; 

Figure 7a shows in more detail a part of a system according to the invention; and 
30 Figure 7b shows a detail of figure 7a. 
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Reference to the figures 1 and 2 was made above in connection, with the description 
of prior art, so in the following description of the invention and its preferred em- 
bodiments reference is mainly made to the figures 3 to 7b, 



5 DETAILED DESCRIPTION OF THE INVENTION 

Figure 3 shows the location of a sound source in point 300 and the direction 301 of 
the zero azimuth. In the figure it is assumed that we want to represent the sound 
source located in point 300 with four filters, of which the first one represents the 
sound propagating from the sound source in the direction 302, the second one repre- 

10 sents the sound propagating from the sound source in the direction 303, the third 
one represents the sound propagating from the sound source in the direction 304, 
and the fourth one represents the sound propagating from the sound source in the 
direction 305, Further it is assumed in the figure that the sound propagates symmet- 
rically in relation to the direction 301 of the zero azimuth, so that in fact each of the 

15 directions 302 to 305 represents any corresponding direction on a conical surface 
which is obtained by rotating the radius representing the examined direction around 
the direction 301 of the zero azimuth, The invention is not limited to these assump- 
tions, but some features of the invention are more easily understood by considering 
first a simplified embodiment of the invention. In the figure the directions 302 to 

20 305 are shown as equidistant lines in the same plane, but the directions can as well 
be selected arbitrarily. 

Each filter shown in figure 3 and representing the sound propagating in a direction 
different from the zero azimuth direction is shown symbolically by a bloclc 306, 
307, 308 and 309. Each filter is characterized by a certain transfer function H,-, 
25 where i e {1, 2, 3, 4}. The transfer functions of the filters are normalized so that a 
sound propagating in relation to the zero azimuth is the same as the sound as such 
generated by the sound source. Because a sound is typically a function of time the 
sound generated by the sound source is presented as X(t). Each filter 306 to 309 
generates a response Yi(t), where i e {1, 2, 3, 4}, according to the equation 

30 Y £ (t)=H t *X(t) (1) 

where * represents convolution in relation to the time. The response Yj(t) is the 
sound directed into the direction in question. 

In it simplest form the transfer function means that the impulse X(t) i3 multiplied by 
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a real number, Because it is natural to choose the zero azimuth as that direction in 
which the strongest sound is directed, then the simplest transfer functions of the fil- 
ters 306 to 309 are real numbers between zero and one, these limits included. 

A simple multiplication by real numbers does not take into account importance of 
5 the pitch for the directivity of the sound. A more versatile transfer function is such 
where the impulse is divided into predetermined frequency bands, and each fre- 
quency band is multiplied by its own amplification factor, which is a real number. 
The frequency bands can be defined by one number which represents the highest 
frequency of the frequency band. Alternatively certain real number coefficients can 
10 now be presented for some example frequencies, whereby a suitable interpolation is 
applied between these frequencies (for instance, if there is given a frequency of 400 
Hz and a factor 0.6; and a frequency of 1000 Hz and a factor is 0.2, then with 
straightforward interpolation we get the factor 0.4 for the frequency 700 Hz). 

Generally it can be stated that each filter 306 to 309 is a certain ICR or FIR filter 
15 (Infinite Impulse Response; Finite Impulse Response) having a transfer function H 
which can be expressed with the aid of a Z-transform H(z). When we take the Z- 
transform X(t) of the impulse X(t) and the Z-transform Y(t) of the impulse Y(t), then 
we get the definition 
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20 whereby it is sufficient to express the coefficients [b 0 bi ai t>2 a^ ...] used in model- 
ing the Z-transfonn in order to express an arbitrary transfer function. The upper 
limits N and M used in the summing represent that accuracy at which it is desired to 
define the transfer function. In practice they are determined by how large capacity is 
available in order to store and/or to transmit in a transmission system the coeffi- 

25 cients used to model each single transfer function. 

Figure 4 shows how the sound generated by a trumpet is directed, as expressed by 
the zero azimuth and according to the invention also with eight frequency dependent 
transfer functions and interpolations between them. The manner in which the sound 
is directed is modeled in a three-dimensional coordinate system where the vertical 
30 axis represents the sound volume in decibels, the first horizontal axis represents the 
direction angle in degrees in relation to the zero azimuth, and the second horizontal 
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axis represents the frequency of the sound in kilohertz. Thanks to the interpolations 
the sound is represented by a surface 400, At the upper left edge of the figure the 
surface 400 is limited by a horizontal line 401, which expresses that the volume is 
frequency independent in the zero azimuth direction. At the upper right edge the 
5 surface 400 is limited by an almost horizontal line 402, which indicates that the vol- 
ume does not depend on the direction angle at very low frequencies (at frequencies 
which approach 0 Hz). The frequency responses of the filters representing different 
direction angles are curves which start from the line 402 and extend downwards 
slantingly to the left in the figure. The direction angles are equidistant and their 
10 magnitudes are 22.5°, 45°, 67,5°, 90°, 112.5°, 135°, 157.5° and 180°. For instance 
the curve 403 represents the volume as a function of the frequency regarding the 
sound which propagates in the angle 157.5° as measured from the zero azimuth, and 
this curve shows that in this direction the highest frequencies are attenuated more 
thau the low frequencies. 

15 The invention is suitable for the reproduction in local equipment where the acoustic 
virtual environment is created in the computer memory and processed in the same 
connection, or it is read from a storage medium, such as a DVD disc (Digital Ver- 
satile Disc) and reproduced to the user via audiovisual presentation means (displays, 
speakers). The invention is further applicable in system where the acoustic virtual 

20 environment is generated in the equipment of a so called service provider and 
transmitted to the user via a transmission system. A device, which to a user repro- 
duces the directed sound processed in a manner according to the invention, and 
which typically enables the user to select in which point of the acoustic virtual envi- 
ronment he wants to listen to the reproduced sound, is generally called the receiving 

25 device. This term is not intended to be limiting regarding the invention. 

When the user has given the receiving device information about in which point of 
the acoustic virtual environment he wants to listen to the reproduced sound, the re- 
ceiving device determines in which way the sound is directed from the sound source 
towards said point In figure 4 this means, graphically examined, that when the re- 

30 ceiving device has determined the angle between the zero azimuth of the sound 
source and the direction of the examination point, then it cuts the surface 400 with a 
vertical plane which is parallel to the frequency axis and cuts the direction angle 
axis at that value, which indicates the angle between the zero azimuth and the ex- 
amination point The section between the surface 400 and said vertical plane is a 

35 curve which represents the relative volume of the sound detected in the direction of 
the examination point as a function of the frequency. The receiving device forms a 
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filter which realizes a frequency response according to said curve, and directs the 
sound generated by the sound source through the filter which it has formed, before 
it is reproduced to the user. If the user decides to change the location of the exami- 
nation point the receiving device deteimines a new curve and creates a new filter in 
5 the manner described above. 

Figure 5 shows an acoustic virtual environment 500 having three virtual sound 
sources 501, 502 and 503 which are differently directed. The point 504 represents 
the examination point chosen by the user. In order to explain the situation shown in 
figure 5 there is created according to the invention for each sound source 501, 502 

10 and 503 an own model representing how the sound is directed, whereby the model 
in each case can be roughly according to the figures 3 and 4, however, taking into 
account that the zero azimuth has a different direction for each virtual sound source 
in the model. La this case the receiving device must create three separate filters in 
order to take into account how the sound is directed. In order to create the first filter 

15 there are determined those transfer functions which model how the sound transmit- 
ted by the first sound source is directed, and with the aid of these and an interpola- 
tion there is created a surface according to figure 4. Further there is determined the 
angle between the direction of the examination point and the zero azimuth 505 of 
the sound source 501, and with the aid of this angle we can read the frequency re- 

20 sponse in said direction on the above mentioned surface. The same operations are 
repeated separately for each sound source, The sound which is reproduced to the 
user is the sum of the sound from all three sound sources, and in this sum each 
sound has been filtered with a filter modeling how said sound is directed, 

According to the invention we can, in addition to the actual sound sources, also 
25 model sound reflections, particularly early reflections. In figure 5 there is formed by 
an image source method known per se an image source 506 represents how the 
sound transmitted by the sound source 503 is reflected from an adjacent wall. This 
image source can be processed according to the invention in exactly the same way 
as the actual sound sources, in other words we can determine for it the direction of 
30 the zero azimuth and the sound directivity (frequency dependent, when required) in 
directions differing from the zero azimuth direction. The receiving device repro- 
duces the sound "generated" by the image source by the same principle as it uses for 
the sound generated by the actual sound sources. 

Figure 6 shows a system having a transmitting device 601 and a receiving device 
35 602. The transmitting device 601 generates a certain acoustic virtual environment 
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which, comprises at least one sound source and the acoustic characteristics of at least 
one space, and it transmits the environment in some form to the receiving device 
602. The transmission can be effected for instance as a digital radio or television 
broadcast; or via a data network. The transmission can also mean that the transmit- 
5 ting device 601 generates a recording such as a DVD disc (Digital Versatile Disc) 
on the basis of the acoustic virtual environment which it has generated, and the user 
of the receiving device acquires this recording for his use. A typical application de- 
livered as a recording could be a concert where the sound source is an orchestra 
comprising virtual instruments and the space is an electrically modeled imagined or 

10 real concert hall, whereby the user of the receiving device with his equipment can 
listen to how the performance sounds in different places of the hall. If this virtual 
environment is audiovisual, then it also comprises a visual section realized by com- 
puter graphics. The invention does not require that the transmitting device and the 
receiving device are different devices, but the user can create a certain acoustic vh> 

15 tual environment in one device and use the same device for examining his creation. 

In the embodiment presented in figure 6 the user of the transmitting device creates a 
certain visual environment, such as a concert hall with the aid of the computer 
graphics tools 603, and a video animation, such as the players and the instruments 
of a virtual orchestra with corresponding tools 604, Further he enters via a keyboard 

20 605 certain directivities for the sound sources of environment which he created, 
most preferably the transfer functions which represent how the sound is directed 
depending on the frequency, The modeling of how the sound is directed can also be 
based on measurements which have been made for real sound sources^ then the di- 
rectivity information is typically read from a database 606. The sounds of the virtual 

25 instruments are loaded from the database 606. The transmitting device processes the 
information entered by the user into bit streams in the blocks 607, 608, 609 and 610, 
and combines the bit streams into one data stream in the multiplexer 611, The data 
stream is supplied in some form to the receiving device 602 where the demultiplexer 
612 from the data stream separates the image section representing the static envi- 

30 ronment into the block 613, the time dependent image section or the animation into 
the block 614 3 the time dependent sound into the block 615, and the coefficients 
representing the surfaces into the block 616. The image sections are combined in the 
display driver block 617 and supplied to the display 618. The signals representing 
the sound transmitted by the sound sources are supplied from the block 615 into the 

35 filter bank 619 having filters with transfer functions which arc reconstructed with 
the aid of the a and b parameters obtained from the block 616. The sound generated 
by the filter bank is supplied to the headset 620. 



11 



The figqres 7a and 7b show in more detail a filter arrangement of the receiving de- 
vice with which it is possible to realize the acoustic virtual environment in the man- 
ner according to the invention. Also other factors related to the sound processing are 
taken into account in the figures, and not only the sound directivity modeling ac- 
5 cording to the invention. The delay means 721 generates the mutual time differences 
of the different sound components (for instance the mutual •time differences of 
sounds which have been reflected along different paths, or of virtual sound sources 
located at different distances). At the same time the delay means 721 operates as a 
demultiplexer which directs the correct sounds into the correct filters 722, 723 and 

10 724. The filters 722, 723 and 724 are parametrized filters which are described in 
more detain in figure 7b. The signals supplied by them are on one hand branched to 
the filters 701, 702 and 703, and on the other hand via adders and an amplifier 704 
to the adder 705, which together with the echo branches 706, 707, 708 and 709 and 
the adder 710 and the amplifiers 711, 712, 713 and 714 form a coupling known per 

15 se, with which post-echo can be generated to a certain signal. The filters 701, 702 
and 703 are directional filters known per se which take into account the differences 
of the listener's auditory perception in different directions, for instance according to 
the HRTF model (Head-Related Transfer Function). Most advantageously the filters 
701, 702 and 703 also contain so called ITD delays (Mteraural Time Difference) 

20 which model the mutual time difference of the sound components arriving from dif- 
ferent directions to the listener's ears. 

In the filters 701, 702 and 703 each signal component is divided into the right and 
the left channels, or in a multichannel system generally into N channels. All signals 
related to a certain channel are combined in the adder 715 or 716 and directed to the 

25 adder 717 or 718, where the post-echo belonging to each signal is added to the sig- 
nal. The lines 719 and 720 lead to the speakers or to the headset. In figure 7a the 
points between the filters 723 and 724 and the filters 702 and 703 mean that the in- 
vention does not limit how many filters there are in the filter bank of the receiving 
device. There may be even hundreds or thousands of filters, depending on the com- 

3 0 plexity of the modeled acoustic virtual environment. 

Figure 7b shows in more detail a possibility to realize the parametrized filter 722 
shown in figure 7a. In figure 7b the filter 722 comprises three successive filter 
stages 730, 731 and 732, of which the first filter stage 730 represents the propaga- 
tion attenuation in a medium (generally air), the second stage 731 represents the ab- 
35 sorption occurring in the reflecting material (it is applied particularly in modeling 
the reflections), and the third stage 732 takes into account both the distance which 
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the sound propagates in the medium from the sound source (possibly via a reflecting 
surface) to the examination point and the characteristics of the medium, such as the 
humidity, pressure and temperature of the air. In order to calculate the distance the 
first stage 730 obtains from the transmitting device information about the location of 
5 the sound source in the coordinate system of the space to be modeled, and from the 
receiving device information about the coordinates of the that point which the user 
has chosen as the examination point, The first stage 730 obtains the data describing 
the characteristics of the medium either from the transmitting device or from the re- 
ceiving device (the user of the receiving device can be enabled to set desired me- 

10 dium characteristics). As a default the second stage 731 obtains from the transmit- 
ting device a coefficient describing the absorption of the reflecting surface, though 
also in this case the user of the receiving device can be given a possibility to change 
the characteristics of the modeled space. The third stage 732 takes into account how 
the sound transmitted by the sound source is directed from the sound source into 

15 different directions in the modeled space; thus the third stage 732 realizes the in- 
vention presented in this patent application. 

Above we have generally discussed how the characteristics of the acoustic virtual 
environment can be processed and transmitted from one device to another device by 
using parameters. In the following we discuss how the invention is applied to a cer- 

20 tain data transmission form. Multimedia means a mutually synchronized presenta- 
tion of audiovisual objects to the user. It is thought that interactive multimedia pres- 
entations will come into large-scale use in future, for instance as a form of enter- 
tainment and teleconferencing. From prior art there are known a number of stan- 
dards which define different ways to transmit multimedia programs in an electrical 

25 form, In this patent application we discuss particularly the so called MPEG stan- 
dards (Motion Picture Experts Group), of which the MPEG-4 standard being pre- 
pared at the time when this patent application is filed has as an aim that the trans- 
mitted multimedia presentation can contain real and virtual objects, which together 
form a certain audiovisual environment The invention is not in any way limited to 

30 be used only in connection with the MPEG-4 standard, but it can be applied for in- 
stance in the extensions of the VRML97 standard, or even in future audiovisual 
standards which are unknown for the time being. 

A data stream according to the MPEG-4 standard comprises multiplexed audiovis- 
ual objects which can contain a section which is continuous in time (such as a syn- 
35 thesized sound) and parameters (such as the location of the sound source in the 
space to be modeled). The objects can be defined to be hierarchic, whereby so 
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called primitive objects are on the lowest level of the hierarchy. In addition to the 
objects a multimedia, program according to the MPEG-4 standard includes a so 
called scene description which contains such information relating to the mutual re- 
lations of the objects and to the arrangement of the general setting of the program, 
5 which information most advantageously is encoded and decoded separately from the 
actual objects. The scene description is also called the BIFS section (Binary Format 
for Scene description). The transmission of an acoustic virtual environment accord- 
ing to the invention is advantageously realized by using the structured audio lan- 
guage defined in the MPEG-4 standard (SAOL/SASL; Structured Audio Orchestra 
10 Language / Structured Audio Score Language) or the VRML97 language. 

In the above mentioned languages there is at present defined a Sound node which 
models the sound source. According to the invention it is possible to define an ex- 
tension of a known Sound node, which in this patent application is called a Direc- 
tiveSound node. In addition to the known Sound node it further contains a field, 
15 which here is called the directivity field and which supplies the information required 
for reconstruct the filters representing the sound directivity. Three different alterna- 
tives for modeling the filters were presented above, so below we describe how these 
alternatives appear in the directivity field of a Directives ound node according to the 
invention. 

20 According to the first alternative each filter modeling a direction different from a 
certain zero azimuth corresponds to a simple multiplication by an amplification 
factor being a standardized real number between 0 and 1. Then the contents of the 
directivity field could be for instance as follows; 

((0.79 0,8) (1.57 0.6) (2,36 0,4) (3.14 0,2)) 

25 In this alternative the directivity field contains as many number pairs as there are 
directions differing from the zero azimuth in the sound source model. The first 
number of a number pair indicates the angle in radians between the direction in 
question and the zero azimuth, and the second number indicates the amplification 
factor in said direction. 

30 According to the second alternative the sound in each direction differing from the 
direction of the zero azimuth is divided into frequency bands, of which each has its 
own amplification factor. The contents of the directivity field could be for instance 
as follows: 
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((0.79 125.0 0,8 1000.0 0.6 4000.0 0.4) 
(1.57 125.0 0.7 1000.0 0,5 4000.0 0.3) 
(2.36 125.0 0.6 1000.0 0.4 4000.0 0,2) 
(3.14 125,0 0.5 1000.0 0.3 4000.0 0.1)) 

In this alternative the directivity field contains as many number sets, separated from 
each other by the inner parentheses, as there are directions differing from the direc- 
tion of the zero azimuth in the sound source model, In each number set the first 
number indicates the angle in radians between the direction in question and the zero 
a2imuth. After the first number there are number pairs, of which the first one indi- 
cates a certain frequency in hertz and the second is the amplification factor. For in- 
stance the number set (0.79 125.0 0.8 1000,0 0.6 4000.0 0.4) can be interpreted so 
that in the direction 0.79 radians an amplification factor of 0.8 is used for the fre- 
quencies 0 to 125 Hz, an amplification factor of 0.6 is used for the frequencies 125 
to 1000 Hz, and an amplification factor of 0.4 is used for the frequencies 1000 to 
4000 Hz. Alternatively it is possible to use a notation where the above mentioned 
number set means that in the direction 0.79 radians the amplification factor is 0.8 at 
the frequency 125 Hz, the amplification factor is 0.6 at the frequency 1000 Hz, and 
the amplification factor is 0.4 at the frequency 4000 Hz, and the amplification fac- 
tors at other frequencies are calculated from these by interpolation and extrapola- 
tion. Regarding the invention it is not essential which notation is used, as long as 
the used notation is known to both the transmitting device and the receiving device. 

According to the third alternative a transfer function is applied in each direction dif- 
fering from the zero azimuth, and in order to define the transfer function there are 
given the a and b coefficients of its Z-transform. The contents of the directivity field 
could be for instance as follows; 

((45 b 4 5, 0 b 45( i a45 >x b 45j 2 345,2 -0 
(90b 90> o b 9 o,i ^cu b 90 ^ asa^ .„) 
(135 b l35 ,o bi35 ( i ai 35>1 b^^ a i3 5^ ...) 
(180bi 80j o biacu a i30 ,i b 180 ;2 a 180 ^ -0) 

In this alternative the directivity field also contains as many number sets, separated 
from each other by the inner parentheses, as there are directions differing from the 
direction of the zero azimuth in the sound source model. In each number set the first 
number indicates the angle, this time in degrees, between the direction in question 
and the zero azimuth; in this case, as also in the cases above, it is possible to use 
any other known angle units as well. After the first number there are the a and b co- 
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efficients which determine the Z-transform of the transfer function used in the di- 
rection in question. The points after each number set mean that the invention does 
not impose any restrictions on how many a and b coefficients define the Z- 
transforms of the transfer function. In different number sets there can be a different 
5 number of a and b coefficients. In the third alternative the a and b coefficients could 
also be given as their own vectors, so that an efficient modeling of FIR or all-pole- 
IIR filters would be possible in the same way as in the publication Ellis, S. 1998: 
"Towards more realistic sound in VMKL". Proc. VRML'98, Monterey, USA, Feb. 
16-19, 1998, pp.95-100. 

10 The above presented embodiments of the invention are of course only intended as 
examples, and they do not have any effect of restricting the invention. Particularly 
the manner in which the parameters representing the filters are arranged in the di- 
rectivity field of the DirectiveSound node can be chosen in veiy many ways. 
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CLAIMS 

1. A method for processing an acoustic virtual environment in an electronic de- 
vice, said acoustic virtual environment comprising at least one sound source (300) 3 
the method comprising the steps of 

- establishing a direction dependent filtering arrangement and a set of parameters, 

- associating said direction dependent filtering arrangement with at least one sound 
source and 

- converting a first signal representing the sound emitted by said at least one sound 
source into a second signal representing a directed sound in said filtering arrange- 
ment in a manner determined by said set of parameters. 

2. A method according to claim 1 3 comprising the steps of 

- defining a certain reference direction and a set of directions differing from it for 
said at least one sound source, and 

- associating a filter with each direction differing from the determined reference di- 
rection so that the effect of each filter on the signal representing the sound emitted 
by said at least one sound source depends on a set of parameters relating to the fil- 
ter. 

3. A method according to claim 2, wherein said parameters relating to each filter 
are amplification factors in order to determine the relative amplification of the 
sound directed in different directions from the sound source. 

4. A method according to claim 3, wherein said amplification factors comprise 
separate amplification factors for different frequencies of the sound in at least one 
determined direction differing from the reference direction. 

5. A method according to claim 2, wherein said parameters related to each filter 
are the coefficients [bo bi ai b 2 a^ of the quotient expression 

x<z) i+Z^- k 

Ar=i 



of the Z-transfonn of the transfer function of the filters. 
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6. A method according to claim 2, additionally comprising the step of interpola- 
tion between said filters in order to model how the sound emitted by said at least 
one sound source is directed in those directions that differ from the reference direc- 
tion and said defined other directions. 

7. A method according to claim 1, comprising the steps of 

- generating in a transmitting device a certain acoustic virtual environment compris- 
ing sound sources, 

- establishing in said transmitting device a set of filters and a set of parameters as- 
sociated with each filter to define the effect of the filters on sound, 

- transmitting from said transmitting device to a receiving device information about 
said parameters associated with each filter, and 

" ^ order to reconstruct the acoustic virtual environment, creating in said receiving 
device a filter bank comprising filters whose effect on a signal depends on a set pa- 
rameters related to each filter, and generating the parameters related to each filter on 
the basis of the information transmitted by the transmitting device, 

8. A method according to claim 7, wherein the transmitting device transmits to 
the receiving device information about said parameters related to each filter as a part 
of a data stream according to the MPEG-4 standard. 

9. A method according to claim 1, wherein said sound source is a primary sound 
source. 

10. A method according to claim 1, wherein said sound source is a reflection, 

11. A system for processing an acoustic virtual environment comprising at least 
one sound source, said system comprising means for creating a filter bank compris- 
ing parametrized filters in order to model how the sound is directed from the sound 
sources belonging to the acoustic virtual environment. 

12. A system according to claim 1 1, comprising a transmitting device and a receiv- 
ing device and means for realizing an electrical communication between the 
transmitting device and the receiving device, 

13. A system according to claim H, comprising multiplexing means in the 
transmitting device for adding parameters representing the parametrized filters to a 
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data stream according to the MPEG-4 standard, and demultiplexing means in the 
receiving device for detecting the parameters representing the parametrized filters 
from the data stream according to the MPEG-4 standard, 

14. A system according to claim 11, comprising multiplexing means in the 
transmitting device for adding parameters representing the parametrized filters to a 
data stream according to the extended VRML97 standard, and demultiplexing 
means in the receiving device for detecting the parameters representing the 
parametrized filters from the data stream according to the extended VRML97 stan- 
dard. 
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Abstract 

An acoustic virtual environment is processed in an electronic device. The acoustic 
virtual environment comprises at least one sound source (300). In order to model the 
manner in which the sound is directed, a direction dependent filtering arrangement 
(306, 307, 308, 309) is attached to the sound source, whereby the effect of the filter- 
ing arrangement on the sound depends on predetermined parameters. The directivity 
can depend on the frequency of the sound. 
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